m 



X 



Quantitative Breuer-Major Theorems 

Ivan Nourdin* Giovanni Peccati^ Mark Podolskij^ 



June 3, 2010 



Abstract 



o 

(N 

^i , We consider sequences of random variables of the type 5„ = n^^'^ Sfc=i{/(-'^fc) ~ 

"^ I E[f{Xi.)]}, n > 1, where X = (^/fc)fcgz is a d-dimensional Gaussian process and 

2 ' / : M — ^ R is a measurable function. It is known that, under certain conditions on / 

and the covariance function r of X, Sn converges in distribution to a normal variable 
S. In the present paper we derive several explicit upper bounds for quantities of the 

CN ■ type |E[/i(5„)] — E[/i(S')]|, where /i is a sufficiently smooth test function. Our meth- 

ods are based on Malliavin calculus, on interpolation techniques and on the Stein's 

(^ ', method for normal approximation. The bounds deduced in our paper depend only on 

Var[/(Xi)] and on simple infinite series involving the components of r. In particular, 
our results generalize and refine some classic CLTs by Breuer-Major, Giraitis-Surgailis 

\^ , and Arcones, concerning the normal approximation of partial sums associated with 

f^ I Gaussian-subordinated time-series. 
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1 Introduction 

Fix d > 1 and consider a d-diniensional centered stationary Gaussian process X = {Xk)kez, 
Xk = (Xl , . . . , Xl ), defined on a probability space (^2, J-', P). For any 1 < i,l < d and 
j G Z, we denote by 

rW)(j) = E[XPx«^.], (1.1) 

the covariance of XJ and XJ_,_ •. Let / : M'^ — > M be a measurable function and write 

1 " 
Sn = ^J2^f{X,)-E[f{X,)]}, n>l, (1.2) 

to indicate the sequence of normalized partial sums associated with the subordinated pro- 
cess k I—)- f{Xk). One crucial problem in Gaussian analysis is the following: 

Problem P. Find conditions on f and on the covariance r in order to have 
that, as n —> oo, Sn converges in distribution to a Gaussian random variable. 

Albeit easily stated, Problem P is indeed quite subtle. For instance, as observed e.g. 
in [SI p. 429], it is in general not possible to deduce a solution to Problem P by using 
standard central limit results for dependent random variables (for instance, by applying 
techniques based on mixing). More to the point, slight variations in the form of / and r 
may imply that either the normalization by the factor n^^"^ is inappropriate, or the limiting 
distribution is not-Gaussian (or both): see Dobrushin and Major [16], Rosenblatt [33] and 
Taqqu [381 EH] for several classic results connected to this phenomenon, as well as Breton 
and Nourdin [7] for recent developments. 

It turns out that an elegant solution to Problem P can be deduced by using the notion 
of Hermite rank. Recall that the function / is said to have Hermite rank equal to q with 
respect to X, where g > 1 is an integer, if (a) E[(/(X) — K[f {X)])pjn{X)] = for every 
polynomial Pm (on W^) of degree m < g — 1; and (b) there exists a polynomial Pq of degree 
q such that E[(/(X) - E[f{X)])pq{X)] ^ (see also Proposition EH below). Then, one 
has the following well-known statement: 

Theorem 1.1 (Breuer-Major theorem for stationary vectors) LeiE[/^(Xi)] < oo, 

and assume that the function f has Hermite rank equal to q > 1. Suppose that 

5^|rW)(j)r<oo, Vz,/G{l,...,rf}. (1.3) 

Then cr^ := Var[/^(Xi)] + 2 ^^-|^ Cov[/(Xi), /(Xi+jt)] is well-defined, and belongs to 
[0,oo). Moreover, one has that 

Sr,^Sr^N{0,a^), (1.4) 

where N{0, a"^) indicates a centered Gaussian distribution with variance a^ , and — > stands 
for convergence in distribution. 
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In the case d = 1, Theorem 11.11 was first proved by Breuer and Major in [8], whereas 
Theorem 4 in Arcones |2] proves the statement for a general d (both proofs in [21 [8] are 
based on the method of cumulants and diagram formulae - see e.g. |31l l36]). The reader 
is referred to Sun |35| for an early statement in the case of a Hermite rank equal to 2, and 
to Giraitis and Surgailis [18] for some continuous-time analogous of Theorem 11.11 Note 
that any central limit result involving Hermite ranks and series of covariance coefficients 
is customarily called a 'Breuer-Major Theorem', in honor of the seminal paper [8]. 

Theorem 11.11 and its variations have served as fundamental tools for Gaussian approx- 
imations in an impressive number of applications, of which we provide a representative 
(recent) sample: renormalization of fractional diffusions [1], power variations of Gaussian 
and Gaussian- related continuous-time processes [31 IH [13 EI], Gaussian fluctuations of 
heat-type equations [3], estimation of Hurst parameters of fractional processes [H [T31 fT¥| . 
unit root problems in econometrics [10], empirical processes of long- memory time-series 
[23], level functionals of stationary Gaussian fields [20], variations of multifractal random 
walks [22], and stochastic programming [JO]. See also Surgailis [36] for a survey of some 
earlier uses of Breuer-Major criteria. 

Despite this variety of applications, until recently the only available techniques for 
proving results such as Theorem 11.11 were those based on combinatorial cumulants/diagrams 
computations. These techniques are quite effective and flexible (see e.g. [2^ IM] for further 
instances of their applicability), but suffer of a fundamental drawback, namely they do not 
allow to deduce Berry-Esseen relations of the type 

\E[h{Sn)]-E[h{S)]\<ip{n), n>l, (1.5) 

where /i is a suitable test function, and (p{n) — )■ as n — )■ oo. An upper bound such as 
(II. 5p quantifles the error one makes when replacing Sn with S for a flxed n. 

In [2H1 Section 4], the flrst two authors of this paper proved that one can combine 
Malliavin calculus (see e.g. [30]) and Stein's method (see e.g. [1^) to obtain relations such 
as (ll.Sp (for some explicit (p{n)) in the case where: (i) d = 1, (ii) f = Hg is a. Hermite 
polynomial of degree q > 2 (and thus has Hermite rank equal to q), (iii) X is obtained 
from the increments of a fractional Brownian motion of Hurst index H < 1 — (2q)~^, and 
(iv) h is either an indicator of a Borel set or a Lipschitz function. Since under (iii) one has 
that |r(j)| ~ J^^~^, these flndings allow to recover a very special case of Theorem 11.11 (see 
Example 12.61 below for more details on this point). 

The aim of the present work is to extend the techniques initiated in [26] in order to 
deduce several complete quantitative Breuer-Major theorems, that is, statements providing 
explicit upper bounds such as (11.51) for any choice of / and r satisfying the assumptions 
of Theorem 11.11 We stress by now that we will not require that the functions / enjoy any 
additional smoothness property, so that our results represent a genuine extension of the 
findings by Breuer-Major and Arcones. 

As anticipated, our techniques are based on the use of Malliavin operators on a Gaussian 
space, that we combine both with Stein's method and with an interpolation technique 
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(already applied in [281 ES]) which is reminiscent of the 'smart path method' in Spin 
Glasses - see e.g. Talagrand |37| . In particular, the use of Stein's method allows to deal 
with functions h that are either Lipschitz or indicators of the type h = l(_oo,2], whereas the 
use of interpolations requires test functions that are twice differentiable and with bounded 
derivatives. Note that this implies that the convergence (11. 4p takes indeed place in the 
stronger topologies of the Kolmogorov and Wasserstein distances. 

The rest of the paper is organized as follows. Section [2] contains the statements of our 
main results, some examples and applications. Section [3] presents some notions and results 
that are needed to prove our main Theorem 12.21 Section H] is devoted to proofs. 

2 Statement of the main results 

We keep the assumptions and notation of the previous section. For the sake of notational 
simplicity, in the following we shall assume that E[/(Xi)] = 0. Also, we shall assume that 
Xi ~ Nfi{0,ld), implying that X^ , . . . ,Xl are independent A^(0, 1) random variables 
for all A; e Z. Note that this last assumption is not restrictive: indeed, by reduction of 
variables and at the cost of possibly decreasing the value of d, we may always assume that 
Xk ~ Nd{0, S) for an invertible matrix E G M'^^'^, and by a linear transformation we can 
further restrict ourselves to the case Xk ~ Nd{0,ld). Observe that, if f{x) has Hermite 
rank q with respect to Xi, then f{Lx) has the same Hermite rank q with respect to L~^Xi, 
for every invertible matrix L - see also j21 p. 2249]. 

Now, let A denote the set of all vectors a = (ai, . . . , a^) with a^ G N U {0}. For any 
multi-index a G A, we introduce the notation |a| = Yli=i'^i ^^^ '-^' ~ ni=i'^«'- When 
E[/^(Xi)] < oo, the function / possesses the unique Hermite expansion 

d d 

fix) = J2a^l[H^Xx,), a„ = {a\r'E[f{X,)l[H^XM% (2-6) 

qGA 1=1 i=l 

where {Hj)j>q is the sequence of Hermite polynomials, recursively defined as: H^ = 1, and 

H, = 6Hj.u J > 1, 

where 6f{x) = xf{x) — f'{x) (for instance: Hi{x) = x, H2{x) = x^ — 1, and so on). 

The following well-known statement provides a further characterization of Hermite 
ranks. 

Proposition 2.1 Let the notation and assumptions of this section prevail (in particular, 
E[/(Xi)] = and Xi ~ Na{0,ld))- Then, the function f has Hermite rank q > 1 if and 
only if tta = for all a & A with \a\ < q and a^ ^ for some a G A with \a\ = q. In 
particular, if f has Hermite rank q, then its Hermite expansion has the form 

oo d 

fi^) = ^fm{x)^ fm{x) = Y^ aaYlHaXXt). (2.7) 

m=q aeA:\a\=m i=l 
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Remark on notation. Fix a function / sucli tliat E[/(X^)] < oo and / lias Hermite rank 
g > 1. Our main results are expressed in terms of the following collection of coefficients 



K 

e 



max |r^*''^(?)| 
l<J,Kd' ^ '^ 

m.i{0{j) < rf"\V|j| > k} (with inf = cx)) 
fceN 



(2.8) 

(2.9) 

(2.10) 



a^ = E[/^(Xi)] + 2 5^E[/„(Xi)/™(Xi+,)] (for m > g), 



(2.11) 



fc=i 



7n,m,e = /2^n-i ^ ^(j)^ ^ ^(j)"""' (for m > g and 1 < 6 < m - 1). (2.12) 

The coefficients ^(j), /i', 6', cr^ and 7„me will be also combined into the following expres- 
sions (IXT^ -f ETTI) : 



^l,n 



E[/2(X0] 



2i^2 



n 



rf. ^ ^(,).^ + ^ ^(,) 



Jil<'^ 



|j|>" 



A 



A2,jv = 2{2K + dW) 



\ 



E[/2(X0] 5^ E[/^(Xi)] 



m=Af+l 



2/v\-\ ^ ( jm. ™-l /--^-X 2 



3,n,Ar 



el^eKt) ^(^^^^^-"- 



2 '' — ' \ mm. 

m=q \ 1=1 



^4,n,Af — ;; X 



(2.13) 

(2.14) 

(2.15) 
(2.16) 



q<p<s<N 



■s/2 



lp\ p + S fs ~ 1 



s\ p \p 



-^W{s-p)h 



1/2 
n,s,s—p 



A 



5,n,N 



nPi^i)] 



^ q<p<s<N 1=1 \ / \ / 



p + s - 2/)! X 



q<p< 

'd' dP 

X ' 7in,s,s—l ~r 7in,p,p—l 



(2.17) 
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Note that the coefficients K, 9 and cr^ can in general be infinite, and also that, if 
E[/(Xi)^] < oo, if / has Hermite rank g, and if (ll.3p is in order, then 



a 



E 



m=q 



o-„ < OO, 



(2.18) 



where o"^ is defined in Theorem 11.11 

The next statement, which is the main result of the paper, asserts that the quantities 
defined above can be used to write explicit bounds of the type (II. 5p . 

Theorem 2.2 (Quantitative Breuer-Major Theorem) Let the notation and assump- 
tions of this section prevail (in particular, E[/(Xi)] = and Xi ~ -/Vd(0, Id)), ond assume 
that the conditions of Theorem li.il are satisfied. Then, the coefficients appearing in for- 
mulae li2.8\ )- l[2Al\) are all finite. Moreover, the following three bounds are in order. 



(1) For any function h G C'^{W) (that is, h is twice continuously differentiable) with 
bounded second derivative, and for every n > K, 

\E[h{Sn)]-E[h{S)]\ < ||/z"||oofAi,„,+ inf {A2,^ + A3,„,^ + A4.„,^ + A5,„,,^}). (2.19) 



(2) For any Lipschitz function h, and for every n > K , 

\h'\\ 



\K[h{Sn)]-nh{S)]\< 



X <^ A 



2,n 



_^ ^i2K + dW)E[f^X,)] 
(3) For any z ^M., and for every n > K , 

\nsn<z)]-ns<z)\< 



+ 4 inf 

N>q 



(2.20) 



N o 

(J 
m=q m 



T.^..a. 



(2.21) 



72 



a 



\ 



A 



2,n 



o V(2A' + rf'?^)E[/2(Xi)] 



+ 4 inf 

N>q 



^l,n + A 



3,n,N 



A, 



4,n,JV 



+ A 



5,n,N 



E 



N 



-q va 



We will now demonstrate that Theorem 12.21 implies a stronger version of Theorem II. H 
namely that the convergence (11.41) takes place with respect to topologies that are stronger 
than the one of convergence in distribution. To prove this claim, we need to show in 
particular that, under the assumptions of Theorem 11.11 7„,m,e — )■ as n — )■ oo for any 
choice oi m > q and 1 < e < m — 1. This is a consequence of the next Lemma [2.31 In 
what follows, given positive sequences 6„, c„, n > 1, we shall write h^ < c„ whenever 6„/c„ 
is bounded, and 6„ ~ c„ if 6„ < c„ and Cn'^hn- 
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Lemma 2.3 Let {ak)k&z be a sequence of positive real numbers such that Ylkez^T < ^^ 
for some ?Ti G N. If I < e < m — 1, then 



n "1 



|fc|<n 



Proof. Fix 5 G (0, 1), and decompose the sum as Y12=i ~ SL=i + Sfe=fn<5l+i- -^^ ^'^^ Holder 
inequality we obtain (recall that YlT=i ^T i^ finite) 



^-l+e/m 



[n5] / oo \ e/m 

J] flfc < n-i+^/™ (n(5) '""/™ X] «r < c<5'-^/'^ 



fc=l \fc=l 

where c is some constant, as well as 



n In 



A:=[n(5]+1 \fc=[n(5]+l 



n -^+^/'" > a^, S I > flfc 




The first term converges to as (5 goes to zero (because 1 < e < m — 1), and the second 
also converges to for fixed 6 and ri — )■ oo. This proves the claim. □ 

Now recall that, if X, Y are two real- valued random variables, then the Kolmogorov 
distance between the law of X and the law of Y is given by 

dKoi{X,Y) = sup|P(X < z)-F{Y < z)\. (2.22) 

IfE|X|,E|y| < cxD, one can also meaningfully define the Wasserstein distance 

dw{X,Y)= sup |E[/(X)]-E[/(F)]|, (2.23) 

/eLip(i) 

where Lip(l) indicates the collection of all Lipschitz functions with Lipschitz constant < 1. 
Finally, if X, Y have finite second moments, for every constant C > one can define the 
distance 

dciX,Y) = sup |E[/(X)] -E[/(F)]|, (2.24) 

where ^^ stands for the class of all twice continuously differentiable functions having a 
second derivative bounded by C. Note that the topologies induced by dxoi, dw and dc, 
on the probability measures on M, are strictly stronger than the topology of convergence 
in distribution (see e.g. |T7t Ch. 11]). 

The next consequence of Theorem 12.21 provides the announced refinement of Theorem 
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Corollary 2.4 (Breuer-Major, strong version) Let the notation and assumptions of 
this section prevail (in particular, E[/(Xi)] = and Xi ~ Nd{0,ld)), and assume that 
the conditions of Theorem \1.1\ are satisfied. Then, the convergence ( [j.^p takes place with 
respect to the three distances dxai, dw o-nd dc (for all C > 0), namely 

lim dKoi{Sn,S) = lim dw{Sn,S) = lim dc{Sn, S) = 0. 

n— ^oo n—^oo n—^ca 

Proof. Under the assumptions of Theorem 11.11 one has that Ai^n — )■ as n — )■ oo (because 
9 < oo, X]|7i<n^(i)'^ n ~^ as n — 7- oo by bounded convergence). On the other hand, 
because of ( I2.18P and since E[/^(Xi)] < oo, one has that A2^n — >■ as A^ — ;■ oo. Moreover, 
since 'yn,m.,e -^ for any m > q and 1 < e < m — 1 (due to Lemma 12. 3p . one has that 
^j,n,N — ^ 0, j = 3, 4, 5, for any fixed N as n -^ oo. We deduce that inf7v>g{^2,Af + ^3,n,7V + 
^4,n,Af + ^5,n,7v} — > as 72 — > OO. To coucludc the proof, it remains to apply (I2.19p - (l2.2ip . 

n 

Next, we present a simplified version of Theorem 12.21 for d = 1 and / = Hg, where Hg 
is the gth Hermite polynomial. Notice that in this case K = 0. 

Corollary 2.5 (Hermite subordination) Assume thatd = 1, f = Hg andj^j^z kO)!"^ < 
oo. 

(1) For any function h G C^(]R) with bounded second derivative it holds that 

\E[h{Sn)]-E[h{S)]\ < ||/l"||oo(Ai,n + A3,„). (2.25) 

(2) For any Lipschitz function h it holds that 

nKSn)] - nh{S)] I < ^^^ (Ai,„ + A3,„) . (2.26) 

(3) For any z eM. it holds that 

\nSn < z)] -nS<z)\< ^J^t (^A^^^ + A:,^r) , (2.27) 

where s^ is the solution of the Stein's equation associated with the function h{x) = 
l{^oo,z]ix), i.e. Sz solves the differential equation 



l{-oc,z]{x)-^{z) = s'z{x)-XS:,{x), XG 



^) 



with $ being the distribution function of N{0, 1). Furthermore, we have that Hs'^Hoo < 
1 for all z eR. 
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In this context, the constants Ai^n (ind A^^n o-f^^ given by 



Aj\<'n \j\>n 



A3,n = ^E^^'(l) v/(2g-20!7n,,,i 



with '^n,q,i defined by 1^2. 12\) . 

Proof. From Theorem 3.1 in j26] and Theorem 13.21 in Section 3.3 we obtain the estimate 
\E[h{Sn)] - E[h{S)]\ < c^E|a2 - {DF, -DL-'F)r,l 

where Ch = J ^^ (-'-)' '^h ~ J ^^ (2) ^^"^ '^h = j in (3). We readily deduce the 
assertion since E|cr^ — {DF, —DL^^F)sj\ < 2(Ai „ + A^^), which follows from the proof of 
Theorem [221 □ 



We remark that the upper bound in fl2.27p of Corollary 12.51 is stronger than the general 
upper bound obtained in f l2.2ip of Theorem 12.21 

Next, we apply Corollary 12.51 to some particular classes of covariance functions r. 

Example 2.6 (Covariance functions with polynomial decay) Assume that d = 1 
and f = Hq with q >2, and consider a covariance function r which is regular varying with 
parameter a < 0. That is, for all \k\ > 1, \r{k)\ = \k\°'l{\k\), where / is a slowly varying 
function. Recall that for any regular varying function r with parameter a < 0, we have 
the following discrete version of Karamata's theorem (see e.g. [6]): 

a>-l : £%l1!1^^i/(« + i), 

n''+H{n) ' ^ ' 

as n — )■ cxD. Assume now that a < —-, which implies that the conditions of Theorem 12.21 
are satisfied, and ae ^ —\ for any e = l,...,g — 1. By the afore- mentioned convergence 
results we immediately deduce the following estimates (1 < e < g — 1) 

\i\<n 
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Thus, for all three cases of Corollary 12.51 we conclude that 

?T,~^/^ : a < -I 

\E[hiSr.)]-E[h{S)]\<< 



n-lH{n): aG(-l,-^) 
^'^/(n): a G (-^, -i) 

Clearly, the same estimates hold for d{Sn, S), where d = dxoU d = dw or d = dc- 

Example 2.7 (The fractional Brownian motion case) Let d = I, f = Hg with q > 2 
and consider the fractional Gaussian noise Xi = Bj^ — B^^^, where B^ is a fractional 
Brownian motion with parameter H G (0,1). Recall that B^ = {Bf^)t>Q is a centered 
Gaussian process (with stationary increments) with covariance structure given by 

nBtBs] = li\tr+\sr-\t+sn 

It is well-known that the correlation function r of the fractional Brownian noise has the 
following form: 

\r{k)\ = \k\'''-H{\k\), k>l, 

with/(|A;|) -^ 2H\2H-1\ as \k\ -^ oo when iJ 7^ i, and /(|A;|) = for \k\ > 1 when H = |. 
As in the previous example we immediately deduce that 



\E[h{Sn)]-E[h{S)]\ 



with a = 2H — 2 and the same estimates hold for d{Sni S) with d = dxai, d = dw or 
d = dc- Let us remark that these upper bounds coincide with those derived in Theorem 
4.1 in |26|. 

We finally remark that the rate ra"^/^ for a = 2H — 2 G (—2, —1] has been proved to be 
optimal in [2^. For the other two cases the optimality question is still an open problem. 





' n"i/2 : 


a^ (-2,-1 


< < 


^a/2 . 


ae [-1, — ^ 




aq + l 

n 2 ; 


L g-1' q 



3 Toolbox 

3.1 Malliavin calculus on a Gaussian space 

We shall now provide a short introduction to the tools of Malliavin calculus that are 
needed in the proof of our main Theorem 12.21 The reader is referred to [3^ for any 
unexplained definition or result. Let i^ be a real separable Hilbert space. We denote by 
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W = {W{h) : h G io} an isonormal Gaussian process over Sj, that is, W^ is a centered 
Gaussian family indexed by the elements of S) and such that, for every gi, g2 G Sj, 

E[W{g^)W{g2)] ={gi,g2)^. (3.28) 

In what follows, we shall use the notation L'^{W) = L'^{Q,a{W),F). For every q > 1, 
we write i^®'^ to indicate the gth tensor power of Sj; the symbol Sj^'^ indicates the gth 
symmetric tensor power of Sj, equipped with the norm ^/q\\\ ■ ||i^«<?. We denote by Iq the 
isometry between i^®'' and the gth Wiener chaos of X. It is well-known (see again [30| Ch. 
1]) that any random variable F belonging to L'^(W) admits the chaotic expansion: 

oo 

^ = E^«(/'')' (3.29) 

where /o(/o) '■= E[F], the series converges in L^ and the kernels fg G ^3®*^, q > 1, 
are uniquely determined by F. In the particular case where io = L"^ {A, s^ , fi) , with 
{A, s^) a measurable space and /i a a-finite and non-atomic measure, one has that i^®'' = 
L^(A'', i2/®"^,/i®"^) is the space of symmetric and square integrable functions on A'^. More- 
over, for every / G i^®'', Iq{f) coincides with the multiple Wiener-Ito integral (of order q) 
of / with respect to W (see [201 Ch. 1]). It is well-known that a random variable of the 
type Iqif), f G i^®^, has finite moments of all orders (see [T9| Ch. VI]). For every g > 0, we 
write Jq to indicate the orthogonal projection operator on the gth Wiener chaos associated 
with W, so that, if F G L'^{W) is as in IK29^ . then JqF = Iq(fq) for every g > 0. 

Let {cki A; > 1} be a complete orthonormal system in S). Given / G i^®^ and g G i^®'', 
for every r = 0, . . . ,pAq, the rth contraction of / and g is the element of i^®'-^"'"''"^''^ defined 
as 

oo 

f ®r g = ^ {f,ei^® ...®ei^)s^s,r ® {g,ei^® ■■■®ei^)s^®r. (3.30) 

il,...,ir=l 

In the particular case where S^ = L'^{A,^, fi) (with /i non-atomic), one has that 



f ®r 9 — I f{tl, . . . , tp-ri Sl, . . . , Sj.) g{tp~r+li ■ ■ ■ : tp+q-2ri ^l, . . . , Sr)dfl{Si) . . . dfi{Sr)- 
J A^ 

Moreover, f ®o g = f ® g equals the tensor product of / and g while, for p = q, f ®p 
g = {f,g)f^(sp. Note that, in general, the contraction / 0^ fi' is not a symmetric element 
of j^i^Cp+^-^r) rjj^g canonical symmetrization oi f (^r 9 is written f®r9- The following 
multiplication formula is also very useful: if / G i^®^ and g G i)®*^, then 

pAq 



Ip{f)Iq{g) = Eh(^) (^^Ip-,q-2r{f®r9). (3.31) 



r=0 

Let S^ be the set of all smooth cylindrical random variables of the form 

F = g{W{(P,),...,W{^n)), 
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where n > 1, g : M" — > M is a smooth function with compact support and (pi G Sj. The 
Malhavin derivative of F with respect to W is the element of L'^{Q,S^) defined as 



i=l 



dx 



Also, DW{(j)) = (j) for every cp E S). As usual, ©^'^ denotes the closure of S^ with respect 
to the norm || ■ ||i2; defined by the relation 

\\F\\l, = E[F']+E[\\DF\\l]. 

Note that, if F is equal to a finite sum of multiple Wiener-Ito integrals, then F G D^'^. 
The Malliavin derivative D verifies the following chain rule: if (^9 : M" — )■ M is in 't^^^ (that 
is, the collection of continuously different iable functions with bounded partial derivatives) 
and if {-Fj}j=i,...,„, is a vector of elements of D^'^, then (p{Fi, . . . , F„) G ©^'^ and 

DifiF,, . . . , F„) = 5^ -^(Fi, . . . , F^)DFi. 



i=l 



We denote by 6 the adjoint of the operator D, also called the divergence operator. A 
random element u G L'^{Q,Sj) belongs to the domain of 6, noted Doin6, if and only if it 
verifies 

\E{DF,u)^\<Cu\\F\\l2 for any Fg^, 

where c„ is a constant depending only on u. If m G Dom(5, then the random variable S(u) 
is defined by the duality relationship (sometimes called 'integration by parts formula'): 

E[F6{u)]=E{DF,u)^,, (3.32) 

which holds for every F G D^'^. 

The operator L, acting on square integrable random variables of the type (I3.29p . is 
defined through the projection operators {Jq}q>o as L = YlT=o ~QJqi ^^"^ i^ called the in- 
finitesimal generator of the Ornstein- Uhlenbeck semigroup. It verifies the following crucial 
property: a random variable F is an element of DomL (= D^'^) if, and only if, F G DomSD 
(i.e. F G ©^'^ and DF G Dom5), and in this case: 6DF = —LF. Note that a random 
variable F as in (I3.29p is in D^'^ if and only if 



q |l ft6$o ^ CX), 



q=l 

and also E[||DF||^J = X]n>i w'll/gllfi®?- If ^ = -^^(^5^,/^) (with /i non-atomic), then 
the derivative of a random variable F as in (I3.29P can be identified with the element of 
L'^{A X Vt) given by 

oo 

L>„F = ^gVi (/,(-, a)), a e A. (3.33) 

9=1 
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We also define the operator L ^, which is the pseudo-inverse of L, as follows: for every 
F G L'^iW), we set L~^F = X]n>i ~Jq{P)- Note that L~^ is an operator with values in 



!)2'2 and that LL~^F = F - E[F] for all F G ^^(ly). 



3.2 Assessing norms and scalar products 

The following statement plays a crucial role in the proof of Theorem 12.21 

Lemma 3.1 Let F = Lp{h) and G = Isid) with h G i^®^, g G i^®'^ and p < s (p,s > 1). 
Then 



Var 



-\\DG\\l 
s 



i£ftp(;)'(2.-2;)!| 



5'®/5'||fi8'2B-2i, 



(3.34) 



and 



E 



{DF.DG), 



< »! I ^ _ J ) {s- p)m[F^] \\g ®,„p g\y,2. 



pi 



(3.35) 



?g('-KL-.TC:: 



(p + s -2/)!( ||/i®p_i /i|L®2! + ||fi'(S)s-ifi'| 



f,®2i I • 



Proo/. [Proof of (IXMj) ] We have DG = s/,_i(^) so that, by using flX^ 



"'"iinni2 



sll/s-i 



s-1 / -1x2 

s — 1 



1=0 



hs~2~2i{g®i+ig) 



1=1 ^ -^ 

^-1 fs-lV 

s!|kll|«. + s ^(/ - l)M , _ J hs-2i{g®ig) 
1=1 ^ ^ 

E[G^] + .£(/- 1)!(^I J) /2.-2K^®/^)- 



The orthogonality property of multiple integrals leads to (I3.34p . 
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[Proof of (I3.35p ] Thanks once again to (I3.3ip . we can write 

{DF,DG)^ = ps(Vi(/i),J,_i((7)),^ 

^^'~^ fp -1\ fs-l\ 

= pS^Ui ^ j( ^ j Ip+s-2-2l{h^l+ig) 



1=0 

p^** / _ 1 \ / _ 1 \ 



{p + s - 2l)\\\h®ig^^^ 



It follows that 










E 


Vi V 

- {DF, DG),^ 
\s J ^ 


1=1 


V- 


-i) [i- 




Ifi 


< p, then 











(3.36) 



\\h®ig\\l^ip+s-2i) < \\h®i g\\ls,{p+s-2i) = {h ®p_i h, g (g)^.; g)^s>2i 

< \\h®p_ih\\^»2i\\g®s_i gWf^mi 

< 2 ("^ ®P-^ Hm^^ + \\9 ®s-z 9\\l02i) ■ 
li I = p, then 

\\h^P 9\\l^(s-p) < \\h(S)p g\\l»(s-p) < \\h\\l^p\\g(8)s-pg\\^j's>2p. 
By plugging these last expressions into (I3.36p . we deduce immediately (I3.35p . □ 

3.3 Estimates via interpolations and Stein's method 

The forthcoming Theorem 13.21 contains two bounds on normal approximations, that are 
expressed in terms of Malliavin operators. As anticipated, the proof of Point (1) uses 
an interpolation technique already applied in [281 [32] . which is close to the 'smart path 
method' of Spin Glasses ^7\. Point (2) uses estimates from |26| . 

Theorem 3.2 Let F be a centered element o/D-*^'^ and let Z ~ A^(0, cr^), a > 0. 

(1) Suppose that h : M. -^ M. is twice continuously differentiable and has a bounded second 
derivative. Then, 

\E[h{F)]-E[h{Z)]\ < ^^^^-^E\a^ - {DF,-DL~^F),,\. (3.37) 
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(2) Suppose that h : M. -^ M. is Lipschitz. Then, 



\E[h{F)]-E[h{Z)]\ < 



\h'\ 



a 



E\a^ - {DF, -DL-^F)s 



(3.38) 



Proof. (1) Without loss of generality, we may assume that F and Z are independent and 
defined on the same probability space. Fix h as in the statement, and define the function 
^(t) = E[/i(Vl -tF + Viz)], t G [0, 1]. Standard results imply that ^ is differentiable for 
every t G (0, 1), and that 



^'(t) 



■.E[h\y/T^F + ViZ)Z] 



E[h'{VT^F + ViZ)F]. 



2y/i 2^1^ 

By using independence and integration by parts, we obtain immediately that 



o 



—^E\h!{VY^tF^VtZ)Z\ = —E\h!\V^^tF \ VtZ)\. 
2yt 2 



On the other hand, the relation F = LL ^F = —6DL ^F and f l3.32p imply that 

1 n _ ^„, _. 1 



2VT^ 



E[h'{VT^F + ViS)F] 



2y/T^ 



E[h'{y/T^F + ViZ)5{-DL-^F)] 



\E[h"{Vl^F + ViZ){DF, -DL-^F)^,]. 



The conclusion follows from the fact that 

\E[h{F)]-E[h{Z)]\ = \m{l)-m{Q)\< I |^'(t)|dt. 

Jo 

(2) Here we follow the arguments contained in the proof of Theorem 3.1 in [26]. Define 
ha{x) = h{ax), F„ = a~^F, and Z„ = a~^Z ~ iV(0, 1). Let s be the solution of the Stein's 
equation associated with h^, i.e. s solves the differential equation 



h„{x) — E\ha{Z„y\ = s'{x) — xs{x), 



X G 



It is well-known that such a solution is given by s{x) = -4^ floo(h^{t) — ^(t))ip(t)dt, where 
if and $ are the density and the distribution function of iV(0, 1), respectively, and ||s'||oo < 
II^ctIIoo- Since F^ is a centered element of D^'^ it holds that F„ = LL~^F„ = —6DL~^F„. 
By integration by parts formula fl3.32p we deduce that 



\E[h{F)]-E[h{Z)]\ 



< 
< 



E[h,{F,)]-E[h^{Z,)]\ 
E[s'iF,)-FXF^)]\ 
E[s'iF^){l - {DF^,-DL~'F^),,)]\ 
\s'\\ooE\l - {DF^,-DL-^F^)s;\ 
\h'J^E\l - {DF^,-DL-'F,),,\. 
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We conclude by using the relations 11/^^1100 = cr||^'||oo and 



D 



When applied to the special case of a Gaussian random variable F, Theorem 13.21 yields 
the following neat estimates. 

Corollary 3.3 Let F ~ Ar(0, 7^) and Z ~ Ar(0, a^), 7, a > 0. 

(1) For every h twice continuously differentiable and with a bounded second derivative, 

\E[hiF)] - E[h{Z)]\ < ^^^ \a^ - 7^1. (3.39) 

(2) For every Lipschitz function h, 

\E[h{F)]-nh{Z)]\<^^\a'-^\ (3.40) 

' ' cr V 7 



4 Proof of Theorem 12.2 



4.1 Preparation 

First, let us remark that the process X = {Xk)kez can always be regarded as a subset of 
an isonormal Gaussian process {M/^(m) : u G i)}, where i^ is a separable Hilbert space with 
scalar product (-, •)j--|. More precisely, we shall assume (without loss of generality) that, for 
every k E Z and every 1 < / < ci, there exists u^^i G Sj such that 

^P = W{uk,i), and consequently {uk^i, Uk'^i')^, = r^^'^'\k - /c'), 

for every k,k' E 1^ and every 1 </,/'< d. Observe also that Sj can be taken of the form 
S) = L'^{A,^, fi), where fi is cr-finite and non-atomic. 

Using the Hermite expansion (12. 6p of the function / we obtain the Wiener chaos rep- 
resentation 

oo 



m=q 

where the kernels g^^ have the form 

1 " 
C = ^Y1 Yl btUk,t,^---^Uk,t^ (4.41) 



n 

k=l te{l,...,d}^ 
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for certain coefficients bt such that the mapping t H- 6^ is symmetric on {1, ...,(i}™. One 
also has the identities 

oo 

nfl{X,)]=m\ Yl bl rn>q, E[f{X^)] = Y,m\ Yl ^'- 

t£{l,...,d}"^ m=q te{l,...,d}'" 

Here is a useful preliminary result. 



Lemma 4.1 For the kernels g'^ defined in jj-jl^ and any 1 < e < m — 1 we obtain the 
inequality, valid for every n, 

dm 

lie ®e gl\U<i>2(r^-.) < —E[f^{Xi)]-fn,m,e, (4.42) 

where '~fn,m,e is defined by Ii2.1^) . Furthermore, we have that, for every n, 

m\\\gl\\l<,^ < E[fl{Xr)]{2K + d'ie), (4.43) 

where the constants K and 9 are defined, respectively in Ii2. 9\) and Ii2.10\) . 

Proof [Proof of ( I4.42p ] Fix 1 < e < m - 1. Observe that 

_. 71 e 

fci,fc2=l t,sg{l,...,d}™ i=l 



We obtain 



\gm ^e ymllj5®2{m-e) 



< (—mux,)] 



' Yl ^(^1 - hyeih - hye{h - hy''-'e{k2 - k^ 

ki,...,ki=l 



where e{j) is defined in (El]). Since 9{k3 - k^feiki - k^)""-' < 9{k3 - k^Y' + e{ki - k^ 
we deduce that 

n 

n-2 Y ^i^i - k2Y0{k3 - k^yeiki - ksr~'e{k2 - k^^-^ 

ki,...,k4=l 



fceZ |fe|<n |fc|<n 



Hence, we obtain ( I4.42p . 
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[Proof of (I4.43P ] By the Cauchy-Schwarz inequality we have 

< nfrniXl)] 

te{i,...,d}"^ 
We deduce, for any m > q, 



m\ 



y^ btUk,ti ® ■ ■ ■ Uk,t^, ^ btUk+i,ti ® ■ ■ ■ ® Uk+i,t^) 

te{l,...,d}"^ t£{l,...,d}'^ 



I n m 

ml 



ki,k2=^t,s£{l,...,d}^ j=l 

< l2HE[f^{X,)] + m\ Y, m''i E l^*l) ) 

\ \k\>K tG{l,...,d}'" J 

<E[f^{X^)]{2K+ Yidmr)<nfmiX,)]{2K + dW), 

\k\>K 

which imphes (14 .43 p . □ 



The proofs of Point 1 and Point 2 in Theorem 12.21 are similar, and are detailed in the 
subsequent two sections. 

4.2 Proof of Theorem [23]- (1) 

First of all, we remark that 6{j) — )■ as \j\ — t- oo, because Xliez^O)'^ ^ °*^- This implies 
that K < oo, where the constant K is defined in (12. 9p . Moreover, the asymptotic variance 
(T^ is finite. Indeed we have that a^ = Em=g"^!|ldl|®- < HP{Xi)]{2K + dW) due to 

The main proof is composed of several steps. 

(a) Reduction to a finite chaos expansion. We start by approximating Sn by a finite 
sum of multiple integrals. Define 



N 



Sn,N - / Jm{gm)- 



m=q 



Now, let h G C^(M) be a function with bounded second derivative. Since 

\h{x) - h{y) - /i'(0)(x -y)\< -\\h"\\oo{y - xf + \\h"\\^\x\\y - x\ 



Quantitative Breuer-Major Theorems 

for all X, y G M, we immediately obtain that 

|IE[/i(5'„)] — E[/l(S'„^jv)]| < \\h ||oo( -ll'S'n — 5'„^Ar||^2(p) + ||5'„||l2(P)||5'„ — ^n. 

By inequality fl4.43p we deduce that 

\\Sn\\hm<i2K + dW)\\f{X^)\\l,^^^ 
and 



19 



TV L2( 



\^n ~ ^n,N\\L^( 



< 



{2K + dW) J2 Il/-(^i)lli2( 



m=N+l 



1/2 



<i2K + dW)\\fiX,)\\,2^r^[ J2 \\UXi)\\h^ 

m=N+l 

where 6 is defined by f|2.10p . We conclude that 



m=N+l 



which completes the first step. 



1/2 

(4.44) 

D 



(b) Bounds based on the interpolation inequality /i3.37\) . Let Zj\f be a centered Gaus- 



sian random variable with variance X]m=a'^m' ^^ using (I3.37P in the special case F 
Sn,N, Z = Zn and by applying e.g. fl3.33p . we obtain 



E 



hiZ^)] - E[hiSn, 



N, 



1 ^ II 



LH 



(4.45) 



p,s=q 



where 5ps is the Kronecker symbol. This completes the second step. 



D 



(c) The final estimates. Here we give the approximation of the term on the right-hand 
side of (14. 45 p . By (I4.43P and the dominating convergence theorem we immediately deduce 
that 



¥.[s-^\\Dh{g^ 



n\ ||2i 



■«l|2 



IflJ — ^-Wds llf)®^ 



-)■ 



fcez t,/G{i,.--,4^ j=i 
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As in the proof of ( I4.43P we conclude that (recall that we assumed n > K) 

\k\ 



\k\<K t,le{l,...,d}= j=l 



K 



K<\k\<n t,l&{l,...,dy j=l 



\k\ 



\k\>n t,le{l,...,d}'> j=l 



< E[f^{X^)]{ 



'"^^ + ^^ ( E ^(^■) - + E ^(^■)^ 

\j\<n \j\>n 



Thus we have 



TV 



Yh" - s~'\\DlM)\\ 



n\\\2 



L2( 



s=q 



N 

< J2 {\ns-'\\DIsi9:)\\l] - ol\ + ^Var[.-i||Z)/.(^,")||?j) 



s=q 



2H 



- ^^^f'ix,)] \^+d^\Yl ^OT^ + E ^(^■) 



Jil<" 



\i I >" 



N 



Y,JYs.i[s^^\\Dh{g-) 



\l] 



< 2(Ai,„ + A3,„,7v), 

where the last inequality follows directly from Lemma 13.11 and 14.11 On the other hand, 
using the approximation ( I4.43P and Lemma 13.11 and 14.11 once again we deduce that 



q<p<s<N 



L^( 



J2 \\s^'{DIpi9;).Dh{g:))s 



q<s<p<N 



LH 



E 



'P + s 



q<p<s<N 

Thus, we conclude 

N 
m=q 



P 



s-\DIp{g;),Dh{g:))^ ^^_ < 2{A^^r^,N + A,^r^,N ) 



LH 



|/if ^ Cr.mY.m) - h{Sn,N) < || /i"|| oo(-4i,„ + A3^n,N + A4^n,N + A.n.Af), (4.46) 
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which finishes this step. 

(d) Putting things together. We have the inequahty 

\E[h{Sn)]-nh{S)]\ < \E[h{Sn)]-E[h{Sn,N)] 

E[h{ZN)] - E\h{S)\ 



u 



E\h{Sn^^)\ - E\h{Z^)\ (4.47) 



We are left with the derivation of a bound for the third term. By using (I3.39P in the special 
case F = Zn, we deduce that 



E[h{ZN)] - E[h{S)] 



< iiiA" 



E ''.I < ^^4^l|A"ll» E E|£(.f01. (4.48) 



m=N+l 



m=N+l 



N, 



where the last inequality is deduced by Lemma UTTl The latter is smaller than ^||/i"||oo^2 
which together with (I4.44p . (I4.45p and ( I4.46p completes the proof of Theorem 12.21 (1). □ 



4.3 Proof of Theorem [23]- (2) 



Take h Lipschitz and write the inequality (I4.47p . Similar to (I4.44p standard computations 
yield 



\E[h{Sn)]-E[h{Sn,j,)]\ < \\h'\U\Sn-Sn,N\\L2m < \\h'\\^{2K+dW) 



1/2 



\ 



E ii/'-w; 



Il2( 



m=N+l 

By applying inequality (13.38P in the case F = Sn.N, Z = Zn, one has that 

E[h{Sn,N)]-nHZN)]\ 

N 



< 



< 



\h' 






T72 E \ksCrl-s~'{DI,{g;),DlM))s 



LH 



p,s=q 



(S 



m=q m 



77^2(^1^^ + A^^n,N + Ai,n,N + ^5,n, 



N 



where the last inequality is obtained by reasoning as in Part (c) of Section 14.21 Finally, an 
application of inequality (I3.40p in the case F = Z^ yields (since 9 >1) 



w 



^ II"' lloo v;^ 2 ^ 



\h!\ 



2a 



E[h{ZN)\ - E[h{S)\ 

m=N+l 

Putting the above estimates together yields the desired conclusion. 



oo < 
^2,7V- 



n 
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4.4 Proof of Theorem [23]- (3) 

From [T2| Theorem 3.1], one can deduce that 

dKol{Sn,S) < 2^dw{Sn/(T,S/a). 
Hence, we get the desired conclusion by combining this inequahty with fl2.20p . D 

Acknowledgments. We thank Arnaud Guilhn for pointing us out an inaccuracy in a 
previous version. 
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